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Abstract — We study the reconstruction of bandlimited fields 
from samples taken at unknown but statistically distributed sam- 
pling locations. The setup is motivated by distributed sampling 
where precise knowledge of sensor locations can be difficult. 

Periodic one-dimensional bandlimited fields are considered 

■ for sampling. Perfect samples of the field at independent and 
identically distributed locations are obtained. The statistical 
realization of sampling locations is not known. First, it is shown 

■ that a bandlimited field cannot be uniquely determined with 
' samples taken at statistically distributed but unknown locations, 
, even if the number of samples is infinite. Next, it is assumed 

that the order of sample locations is known. In this case, 
using insights from order-statistics, an estimate for the field 
with useful asymptotic properties is designed. Distortion (mean- 
j squared error) and central-limit are established for this estimate. 



I I. Introduction 

In the smart-dust paradigm IT], consider a distributed field 
. sampling problem where sensors are deployed without precise 
' control on the sensor-locations. One method for distributed 
. field sampling is to learn the location of these individual 
' sensors, and then reduce field acquisition to the well-studied 
I non-uniform sampling problem 0. However, localization of 
' individual sensors in a wireless sensor network can be dif- 
. ficult 131. In light of these issues, the reconstruction of a 
' physical field from samples taken at unknown but statistically 
. distributed locations is studied in this work. 

Assuming that the field has a finite support, sensors will 
. have to be deployed in the finite region where the field is non- 
' zero. The smoothness of the physical field can be modeled 
, by bandlimitedness. In this work, it will be assumed that 
' the field is spatially periodic and bandlimited. Only one- 
dimensional fields will be considered. The lack of control in 
sensor deployment is modeled by a uniform-distribution on 
the sensor or sampling-locations. It is assumed that sensors 
are deployed (or scattered) independent of each other Thus, 
perfect samples of the field at independent and identically 
distributed (i.i.d.) but also unknown locations are obtained by 
the sampUng method outlined above. From these samples the 
field has to be estimated. This work focuses on a consistent 
estimate, that is, an estimate which converges to the true 
underlying field when the number of samples is infinite. 
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The key results shown in this work are as follows: 

1) It will be shown that a bandlimited field cannot be 
uniquely determined with perfect samples obtained at 
statistically distributed locations, even if the number of 
samples is infinite. 

2) If the order of sample locations is known, then using 
insights from classical order-statistics, a consistent esti- 
mate for the spatial field is presented. Distortion (aver- 
age mean-squared error) and a central-limit type weak 
convergence result are established for this estimate. 

Prior art: Recovery of discrete-time bandlimited signals from 
samples taken at unknown locations was first studied by 
Marziliano and Vetterli [4|. Recovery of a bandlimited signal 
from a finite number of ordered nonuniform samples at un- 
known sampling locations has been studied by Browning fSj. 
Estimation of periodic bandlimited signals in the presence of 
random sampling location under two models has been studied 
by Nordio et al. |6|. Their first model studies reconstruction 
of bandlimited signal affected by noise at random but known 
locations. Their second model studies estimation of bandlim- 
ited signal from noisy samples on a location set obtained by 
random perturbation of equi-spaced deterministic grid. 

In contrast, this work presents the estimation of a bandlim- 
ited field from i.i.d. distributed but unknown samples in an 
asymptotic setting (where the number of samples increases to 
infinity). Asymptotic consistency (convergence in probability), 
mean-squared error bounds, and central-limit type weak law 
are the focus of this work. The first key-result of this work is 
absent in related work due to difference in the sensing model. 
Organization: In Section the field model, distortion, sensor 
deployment model, and useful statistical theory are outlined. 
In Section |III] asymptotic consistency, mean-squared error, 
and weak convergence aspects of field estimate are discussed. 
Finally, conclusions will be presented in Section IIVI 

II. Problem setup and useful classical results 

This section will review the field model, the distortion, and 
some useful mathematical results. Field model appears first. 

A. Field model and associated properties 

The field of interest g{t) is periodic, real-valued, and 
bandlimited. Without loss of generality, the period is assumed 
to be r = 1. It is also assumed that the field \g{t)\ < 1 is 



bounded. Bandlimitedness implies that some 6 > coefficients 
are non-zero in the Fourier series. Thus, 



g{t) = ^ afccxp(j27rfc<). 



(1) 



k=-b 



Real-valued g{t) implies conjugate symmetry in the Fourier 
domain, that is, = a^^; however, this symmetry will not be 
utiUzed in this work. The (6+1) Fourier coefficients constitute 
the degrees of freedom for this signal. With ||.g||oo < 1, using 
Bernstein's inequality Q, we get 



\g\t)\ < 2TTb, 



(2) 



where 27r6 rad/s is the bandwidth of the signal. For simplicity 
of notation, define si, 1/(25+ 1) as a spacing parameter 
and (pk cxp{j27Tk/{2b + 1)) = cxp(j27rA:sh). By using 
(26+ 1) samples of the field g{t), its Fourier coefficients can 
be computed as follows: 
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or more simply 



g = ^ba, 



(3) 



where the vector matrix notation is obvious. The columns of 
<!>{, are orthogonal with a norm-square (26 + 1) under the 
standard inner-product. The relation in (|3) is inverted to obtain 

-.9 = TT^T^'^U, (4) 



a={<Pb)-'-- 



(26+1) 



where is the conjugate transpose of The expression in 
(|4]l will be used to obtain an estimate for a as discussed later 

B. Sensor deployment model and reconstruction distortion 

Denote any sequence as a;™ := (x;, a;;+i, . . . , Xm) for 
m > L It will be assumed that sensors are deployed at random 
locations [/f in the interval of interest [0,1]. The locations 
Ui are i.i.d. random variables with uniform distribution and 
probability density function f{u) = 1 for < m < 1. The 
locations [/" are not known in our model. An asymptotic 
number of samples and limiting distribution of C/" will be 
used for field estimation. The average mean-squared error will 
be used as a distortion metric. If G{t) is any estimate of g{t), 
then the distortion is defined as 



D:=mG-g\\l) ■■=- 



\G{t) - g{t)\'At 



(5) 



C. Useful mathematical results 

For estimation of field from the statistical properties of 
i/f, the following convergence results will be useful. These 
results for order-statistics and quantiles are a counterpart to the 
strong-law of large numbers (see JS] Ch. 10]). The ordered ver- 
sion of C/f will be denoted by C/{^„" {[/i:„, C/2:„, . . . , [/„:„} 
where [/„:„ is the largest and U\;n is the smallest fSJ. 



For uniform distribution, the p-th population quantile is 
equal to p. Then with r = [np] + 1, it is known that [8 , pg. 285] 

Ur:n-P=- {Fn (p) - p) + i?„ , (6) 

where F„(u) := - ^{Ui < u) is the empirical distri- 

bution of C/f. The remainder term i?„ decreases to almost 
surely, 

Rn = O (^rr''^/^(log7i)i/2(-iogiog„)i/4^ ^ 

By the strong law of large numbers ||9], we know that 
Fn{p) ---^ P\ thus, Ur:n ~> P from O. Analogous to the 
central limit theorem, the following fact is noted. 

Fact 2.1: H Theorem 10.3] Let < pi < p2 < • • • < 
P2b+i < 1 and assume that {ri/n — pi) ~ o(l/-y/n),j = 
1, 2, . . . , 26 + 1. Then the following result holds: 



Vri[Uri;n -pi,...,C/, 



-P2b+l\ 



Aaa(o,av) 



where [Ku]jj' = Pjil - Pj') for j < j'. 

All the moments of U are finite since it is bounded (by 
definition). The second moment of Ur.n — P, with r « [np] is 
bounded by. 

pf =p{l-p)E{Z^)+0{^T/7l), 

<] + 0{^l/^). (8) 



nE{Ur:r 



where Z ^ Af{0, 1) is a normalized Gaussian random variable. 
The following fact relates consistency and convergence. 

Fact 2.2: gl If X„ ^ X and Y,, ^ Y, then aX„ + 
bYn aX+bY for any constants a, 6 e M. If Xn is bounded 

and Xn ^ X, then X„ ^ X. 

We now proceed to the main results of this paper 

III. Sampling and estimation with random samples 

In this section, the key results of this work are presented. It 
will be shown that the field g{t) cannot be inferred uniquely 
from samples collected at where sample-locations are 

unknown. Further, with order information on sample-locations, 
consistent estimation of the field is presented. 

A. It is impossible to infer g{t) uniquely from 

It will be shown that if g{Ui), . . . , g{Un) is available 
without the knowledge of J7", then g{t) cannot be inferred 
uniquely as n — > oo. Consider the statistic 



1 

i=l 



(9) 



where 1() are the indicator random variables. Then 
Fg^n{x),x G [—1, 1] completely characterizes the field values 
g{Ui), . . . ,g{Un) and vice-versa. By Glivenko-Cantelli theo- 
rem, the right hand limit in (|9) converges almost surely to 
Pig{U) < x) for all X G [-1, 1] as n t oo ITOl. This limit is 
explained using Fig. [T] For any x E [—1,1] the set of points 
where g{t) < x can be marked on the t-axis. The length or 
measure of this set is equal to P{g{U) < x). 



([Tol l and (fTTT i. Then the estimates A and G{t) are consistent 
in almost-sure and sense to their respective limits, i.e., 



Fig. 1. For any x G [—1, 1] the set of points where g(t) < x can 
be marked on the t-axis. The length or measure of this set is equal to 

¥{g{U) < x). 



For < 6* < 1, let ge{t) = g{t - 6), i.e., go{t) is the 
shifted version of g{t). Since g{t) is periodic, its shifts will 
be cyclic in nature in the period [0, 1]. Thus, the level-sets of 
g{t — 6) will be cyclic (in 9) and its measure {u : ge{u) < x} 
will be independent of 9 for every x G [—1,1]. Therefore, 
V{ge{U) < x) will be independent of 9 for every x g [—1,1]. 
Thus, by only using Fg^„{x), which converges to ¥{g{U) < 
x),x E [—1, 1], the field g{t) cannot be inferred uniquely. This 
completes the discussion of this subsection. 

B. Consistent estimation of g{t) from U"'^^ 

From now on, it will be assumed that order information 
of samples is available. That is, samples g{Ui:n), ■ ■ ■ ,g{Un:n) 
are available and g{t) has to be estimated. Using (HJi and the 
convergence results in Sec. lII-Cl the following estimate for the 
Fourier series coefficients of g{t) is proposed: 

[A_6,A_b+i,...,Ab]^ :^ (10) 



A 



(26 + i; 



where G = [.g(C/l:n), + ■ • • , .9(t/[,l26s,] + l:n)]^- 

With (|6|l and the smoothness properties (continuity) of g{t), 
this estimate is obtained by substitution method in (|4|l. Using 
A, an estimate for g{i:) is obtained as follows 

b 

Git) = ^kCXp{j2TTkt) = ^tfl (11) 

fe=-b 

where = [ exp(— j27r6i) ... exp(j27r&<) ]. Intu- 

itively, g{t) has a finite degrees of freedom. This enables 
a procedure to estimate the Fourier series coefficients (the 
degrees of freedom) from a finite number of sample estimates 
of g{t). Using these estimates of the Fourier series coefficients, 
the entire field of interest g{t) can be estimated. For distortion 
calculation, the Parseval's theorem ifTTI will be useful. 
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(12) 
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A bound on E(|Afc — afc|^) will result in a bound on the 



\G 



fflli) 



expected mean-squared error E( 
We state our first result now. 

Theorem 3.1 (Consistency of A): Let C/"i^ be ordered 
i.i.d. Uniform[0, 1] random variables. Define A and G{t) as in 



A 



a, G{t) ^ g{t) and A ^ a, G{t) ^ g{t). (13) 



Proof: Only a sketch is provided due to space con- 
straints. First note that U[nis,,]+i:n isb for each 
i = 0,1,..., 2fe. Since g{t) is continuous by assumption, 
9{U[mst]+i:n) ^ g{isb) for cach i = 0,1,..., 2&. Let 

G ■■= [g(C^l:ri),.9(^„Si,] + l:n), • • • ,5(C^[n2&Sb] + l:ri)]^ and g : = 

[g{0),g{sb), ■ ■ ■ ,g(2fesf,)]^. By repeated use of Fact 12.21 any 
finite linear combination cr^G converges almost-surely to cFg. 
Thus, from ( fTOt . each element of A converges almost surely 
to a. Hence, A —4 a. 

Next, G{t) is a finite linear combination of A. Since A 
a, therefore, G{t) g{t) in a similar fashion as above. 

For £^ -convergence, note that G is bounded in each co- 
ordinate since \g{t)\ < 1 for all t. Each element of the 
matrix $f, has a magnitude one. Thus, by (fTOl i and the triangle 
inequality, \Ai\ < \\g\\oo < 1 for every i — —6, —b+1, . . . ,b. 
Thus, each Ai is a bounded random variable. For bounded 
random sequences, from Fact 12.21 A a implies that 

A ^ a. Similarly, |G(t)| < I^^I ^ (2& + 1) from 

(EJ- Thus, by FactO G{t) ^ g{t) implies G{t) g{t), 
since G{t) is bounded. ■ 

The second result establishes the scaling of distortion for 
the proposed estimate in (fTTT i. 

Theorem 3.2: Let U^.^ be ordered i.i.d. Uniform[0, 1] ran- 
dom variables. Define A and G{t) as in (fTOt and (fTTT i. Then, 



IG- 



(14) 



that is, the expected distortion decreases as 0{\/n). 

Proof: The proof is presented in two parts. First, using 
the smoothness properties of g{t), the norm ||G — .g||2 will be 
bounded using the error in quantiles U^np]+i:n ~ P- Next, the 
convergence rate of U[np]+i:n — p as in (O will be utilized to 
upper-bound the distortion. First note that 



|G-.g||^= E \^k~ak 

k=-b 
1 



(15) 
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^ ' 1 h 7 — n 



(6) 



k=-b 1=0 
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(26+1) 



k=-b 1=0 
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< llff'llLEl^[- 



(19) 



(20) 



where (a) follows by (oi + 02 + . . . + a„)^ < n(af + a| + 
. . . + a^), (6) follows by \(j)k\ — 1 for all k, and (c) follows 
since the summation does not depend on k. Using dHJ, and 
taking expectations on both sides 



nE \\G 
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lsi] + l:n 



ISbl') 




< (2^&)^(26+l)- + 0(v/l/n) 
= TT^b^{2b + 1)[1 + 0(v/l>)]. 



(21) 

(22) 
(23) 



This completes the proof. ■ 
The third result establishes the weak-convergence of G{t). 
Theorem 3.3 (Central limit for G{t)): Let U":" be or- 
dered i.i.d. Uniform[0,l] random variables and u = 
(0, Sb, 2sb, . . . 26.Sb)^. Define A and G{t) as in ^ and (fTTl i. 
Then the estimate A and G(t) satisfy the following central 
limits: 

d 



(24) 



where /^g = V {u)KuV g{u) and A'^ is independent of n 
and given in terms of Kq and $f,. Further, 



V7^(G(i)-g(t))^AA(0,AGW 



(25) 



where Koit) is independent of n and given in terms of Kq 
and $f,. 

Proof: From Fact 12.11 we know that U 

C^[n26si,]+i:n]^ is asymptotically 
normal. That is, ^/n{U — u) — > J^{0, K), where 



[K]u, = (^ - l)sb[l - {i' - l)sb] for i < i' . 



(26) 



Note that [i^Tji ^/ = \K\ii by the symmetry of a covariance 
matrix. Recall G from (fTOl l. Since ^(t) is a differentiable field, 
by the delta-method ifTOl . 



(27) 



where AT^ = V g{u)^ KV g{u). Observe that the matrix Kg 
depends on the field g{t). However, by smoothness of g{t), the 
vector Vg{u) is bounded and K is independent of n. Thus, 
Kg is independent of n. From (fTOl i. since A is obtained from 
G by a complex-valued linear transformation, we get 



^{A-d) -^CAf{6,K^). 



(28) 



Observe that the limit is a complex normal Gaussian vector In 
general, the covariance properties of a zero-mean complex ran- 
dom vector S are determined by E{SS^) and E(55^). Thus, 



Kt is determined by the two matrices 



TmK^,^b and 



(2fc+i)^ ^b^^G^I ■ covariance matrix Kg is independent 
of n; therefore, K^ is also independent of n and well defined. 

Finally, G{t) is obtained from A by a t-dependent inner 
product. From (E), we get G{t) = $(t)^A Therefore, G{t) 
is a complex normal Gaussian vector Its variance can be 
determined by E(G(t)2) and E(|G(t)|2) which ai'e equal to 
^^^tr<i>lKg^T^{t) and ^^^tr^lKg<^,^{t)l 
respectively. Thus the proof is complete. ■ 

This completes our technical result section. The estimation 
technique outlined in this section holds well for noise-free 
setting. If there is additive noise affecting the samples, then 
more involved estimation techniques will be required. Obtain- 
ing consistent estimates for g{lsb), / = 0, . . . , (26 + 1) is more 
challenging in the presence of noise. 

IV. Conclusions 

The reconstruction of bandlimited fields from samples taken 
at unknown but statistically distributed sampling locations was 
studied. Periodic one-dimensional bandlimited fields were con- 
sidered for sampling. Perfect samples of the field at i.i.d. uni- 
form locations were used for the reconstruction. It was shown 
that a bandlimited field cannot be uniquely determined only 
with samples taken at statistically distributed locations, even 
if the number of samples is infinite. Using order information 
on the sample locations, a consistent estimate was proposed 
for the underlying field. It was shown that this estimate con- 
verges in the mean-squared error sense and almost-sure sense. 
Further, the mean-squared error asymptotically decreases as 
0{l/n), where n is the number of obtained field samples. 
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